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Tiered Multi-Source Software Support Using 
Automated Diagnostic-Data Transfers 

[01] RELATED APPLICATIONS 

[02] This is a continuation-in-part of copending U.S. Patent 
5 Application 10/442,592, filed May 21, 2003, entitled "Computer 
Service Using Automated Local Diagnostic Data Collection and 
Automated Remote Analysis", attorney docket number 200310433- 
1, which is hereby incorporated by reference in its entirety. 

[03] BACKGROUND OF THE INVENTION 

10 [04] The present invention relates to computers and, more 
particularly, to computer support services. The present invention 
facilitates cooperative support services when the services of more 
than one vendor are required. 

[05] Much of modern progress is associated with the development 
1 5 and proliferation of computers that manipulate data in accordance 
with programs of instructions. Printed and electronic 
documentations are typically made available to assist users in using 
computer programs. However, it is not uncommon for software 
vendors to be inundated with requests for support. 

20 [06] Currently, the software support organizations of many 
software vendors rely on third party software support partners or 
value added resellers (VARs) to alleviate the full burden of 
supporting their software. These third-party support providers 
often provide their direct customers with customized versions of 

25 the base software products as a value add. When there are issues 
with the product, the customer contacts the third party vendor, who 
investigates the problem to determine if it lies within the bounds of 
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the customization or if it is a base product level issue that they 
cannot fix with a known patch or configuration change. 

[07] In the case of a base product issue, the third party vendor 
must in turn contact the software vendor that supplies the base 
5 software product. The original software vendor must then 
determine the cause of the issue and a solution for the issue. This 
information is conveyed back to the third party support provider, 
which in turn must convey the information to the end customer or 
provide the appropriate fix for the customer. In this scenario, the 
1 0 . third-party and original vendor support personnel must spend time 
by both manually examining the customer issues and relaying 
information back and forth between the third party organization 
and base software vendor company. These multiple exchanges 
result in considerable delays for the waiting customer. 

1 5 [08] In another scenario, a first vendor provides software that 
integrates with that of a second vendor. If the vendors do not 
cooperate, customers might find themselves without a solution 
when each vendor attributes a problem to the other's software. If 
they do cooperate, inter-vendor interactions are costly to the 

20 vendors and result in frustrating delays to customers. What is 
needed is a system, preferably highly automated, for providing 
coordinated support from different vendors to a user. 

[09] SUMMARY OF THE INVENTION 

[10] The present invention provides for automated tiered software 
25 support using automated diagnostic data transfers on at least two 
levels. The present invention is most applicable where software 
from one vendor integrates tightly with software from another 
vendor. However, the invention is applicable to almost any 
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combination of hardware and software associated with a common 
computer system. 

[11] As in the single-tier system disclosed in the parent 
application, data gathering software on the user's computer can 
5 gather diagnostic data for a first vendor's application on an ongoing 
basis. When a first-level support session is initiated, the collected 
diagnostic data can be transferred to the vendor's support system. 
The vendor's support system analyzes the diagnostic data and 
attempts to solve a support issue. 

10 [12] If the first-level session fails to provide a support solution, 
the first vendor's system can contact a second vendor's system for 
support. In the course of a second-level support session, diagnostic 
data is transferred from the first vendor's system to the second 
vendor's system. The original diagnostic data from the user system 

1 5 may be modified (e.g., to preserve privacy) and supplemented (e.g., 

with information from the first- vendor's knowledge base) prior to 
transfer to the second vendor. 

[13] The second vendor analyzes the diagnostic data it receives to 
provide a solution or at least information helpful in arriving at a 
20 solution to the first vendor. The first vendor then uses the 
information from the second vendor to provide a solution to the 
user. Also, the second vendor can provide direct support to users, 
and each vendor may serve as a second tier to the other. 
Furthermore, the invention can involve more than two tiers of 

2 5 support. 

[14] From the user's perspective, the knowledge base of plural 
vendors can be accessed in a session with a single vendor. In 
general, the user is not shuttled between vendors that both deny 
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responsibility for a problem. From the vendor's perspective, users 
are automatically and effectively serviced in an economical manner. 
These and other features and advantages of the invention are 
apparent from the description below with reference to the following 
5 drawings. 

[151 BRIEF DESCRIPTION OF THE DRAWINGS 

[16] FIGURE 1 is a schematic illustration of a multi-tier software 
support system in accordance with the present invention. 

[17] FIGURE 2 is a flow chart of a method of the invention 
1 0 practiced in the context of the system of FIG. 1. Steps including an 
"(E)" are subject to an entitlement check. 

[18] DETAILED DESCRIPTION 

[19] The present invention governs interactions among a 
customer 10, a primary support vendor 20, and a secondary support 

1 5 vendor 30. Much of the interaction is automated among their 
respective computer systems 11, 21, and 31. Customer 10 provides 
for human and automated system management 13 of customer 
computer system 11, which runs an application 15 and diagnostic 
software 17. Primary support vendor 20 includes a support 

20 interface 23, which manages the primary support vendor's 
interactions with customer 10 and secondary support vendor 30. In 
addition, interface 23 provides for management of first vendor 
computer system 21, which runs entitlement software 25 and data- 
handling-and-analysis software 27. Secondary support vendor 30 is 

25 analogous to primary support vendor 20, having a support 
interface 33 that manages interactions with customer 10 and first 
support vendor 20, and manages second- support computer 
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system 31, which runs entitlement software 35 and data-handling- 
and-analysis software 37. 

[20] In this embodiment, application software 15, a network 
management program, is developed and marketed by secondary 
5 support vendor 30. The instance of application software on 
customer computer system 11 has been customized by primary 
support vendor 20, a value-added reseller, for customer 10. 
Alternatively, the primary support vendor can be a third-party 
support provider that has not added value to application 15, but has 
1 0 been engaged by a manufacturer to assist with the support function. 

[211 Analysis software 27 is developed from a pre-packaged 
programmable framework with application programming interfaces 
(APIs) so that it can be interfaced with the primary vendor's pre- 
existing hardware and software. Data-handling-and-analysis 
15 software 27 and diagnostic software 17 cooperate as server and 
client, respectively, to provide distributed automated support for 
application 15 running on customer computer 21. 

[22] Diagnostic software 17 monitors application 15 on customer 
computer system 11, gathering configuration and usage data. When 

20 it detects failures in software application 15, diagnostic program 17 
gathers diagnostic data about the fault and the customer 
hardware/software environment. Diagnostic software 17 forwards 
the diagnostic data to data-handling-and-analysis software 27 
running on primary vendor computer system 21. Data-handling- 

25 and-analysis software 27 automatically receives the diagnostic data, 
and has entitlement software 25 to authenticate the customer using 
identification information embedded in the diagnostic data. 
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[23] Data-handling-and-analysis software 27 then analyzes the 
diagnostic data to determine if a solution can be provided by 
primary vendor 20 or whether support from secondary support 
vendor 30 is required. Help from vendor 30 may be required, for 
5 example, when the diagnostic data indicates a problem unrelated to 
customization and not addressed by any solution published by 
primary vendor 20. If secondary support is required, data-handling- 
and-analysis software 27 transmits diagnostic data to analysis 
software 37, and then integrates the response into a "solution" it 
10 makes available to customer 10. This method is described in 
greater detail below. 

[24] Primary support computer system 21 runs entitlement 
software 25 and data-handling-and-analysis software 27. Data- 
handling-and-analysis software 27 is used to analyze diagnostic 
1 5 data gathered by diagnostic software program 1 7 and transmitted 
to primary support computer system 21. Entitlement software 25 is 
used to check, at various stages in a support procedure, whether a 
customer is entitled to any services, and, if so, to what level. 

[25] Secondary support computer system 31 similarly runs 
20 entitlement software 35 and data-handling-and-analysis 
software 37. In this case, data-handling-and-analysis software 37 
analyzes diagnostic data provided by primary-support computer 
system 21. The diagnostic data provided by primary-support 
computer system in general includes at least some of the diagnostic 
25 data received from customer computer system 11. However, some 
information may be removed, especially customer ID information, 
and some may be added, e.g., information about similar situations 
in a knowledge base included in data-handling-and-analysis 
software 27. Entitlement software 35 checks on the level of services 
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primary- support vendor 20 is entitled to from second-support 
vendor 30. 

[26] A method Ml practiced in the context of system API is flow- 
charted in FIG. 2. Primary support vendor 20 registers with 
5 secondary support vendor 30 at step S01 so that secondary-vendor 
entitlement software 35 "knows" primary support vendor and what 
level of support primary support vendor is entitled to. For example, 
the support level and procedures can be different for a value-added 
reseller than for an end-user. Primary support vendor 20 thus can 
1 0 register with secondary support vendor 30 as a value-added reseller. 
Note that primary support vendor 20 may also register as a user, if 
an instance of application 15 is running on primary- vendor 
computer system 21. 

[27] Customer 10 registers, at step S02, with primary support 
1 5 vendor 20 so that primary- support entitlement software is informed 
of the existence and support level for customer 10. Step S02 
occurred after step S01, as primary support vendor 20 desired 
developer support from secondary vendor 30 prior to the time the 
customized version of application 15 was provided to customer 10. 
20 However, the invention provides for these steps to occur in either 
order. 

[28] A fault in application 15 or another triggering condition is 
detected at step S03. A fault can be the failure of a message to be 
delivered as addressed; another triggering event can be a time-based 
25 warning that a license for application 15 or other software is due to 
expire. The event triggers data collection at step S04. Data 
collection step S04 can be on-going, even in the absence of a fault. 
For example, usage, configuration, and context data can be collected 
continuously. However, additional a system "snapshot" can be 
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collected at the time of fault detection, depending on the nature of 
the fault or other triggering event. 

[291 Customer system 1 1 requests support from primary support 
vendor 20 at step SOS. Alternatively, diagnostic software can report 
5 the fault to a human user of computer system 11, who can then 
make the request, e.g., by accessing a website of primary-support 
vendor 20. The request involves transferring diagnostic data 
gathered by diagnostic software 27 to primary support computer 
system 21. 

10 [30] Primary-support data-handling- and-analysis software 27 
analyzes the diagnostic data at step S06. As indicated by the "E" in 
the figure- text description of step S04, the analysis is conditioned 
on an entitlement check. The diagnostic data includes customer 
identification data including, for example, a license or contract 

15 number. Data-handling-and-analysis software 27 extracts the 
identification data and forwards it to entitlement software 25. 
Entitlement software 25 checks the contract ID against an included 
entitlement database. If customer 10 is entitled to the requested 
service, the analysis proceeds immediately. If the entitlement check 

20 indicates customer 10 is not entitled to the requested support, a 
procedure is initiated that will allow customer 10 to become entitled 
(or, to have entitlement recognize, if customer 10 is truly entitled to 
the service). Once customer 10 is entitled to the requested support, 
the analysis continues. 

25 [31] Data-handling-and-analysis software 27 analyzes the usage, 
configuration, and context information along with any 
circumstances relating to the fault that instigated the request. The 
analysis can refer to an included expert system or other such 
system that correlates this problem with other problems and other 
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knowledge. Method Ml then branches at step SOS depending on 
whether a local solution is determined at step S04. 

[32] If the analysis at step S06 yields a solution, it is made 
available to customer 10 at step S06. This can involve notifying 
5 customer 10 that a solution has been identified. For example, 
computer system 21 can generate an e-mail to a contact person at 
customer 10 and include within the e-mail a link specifying a URL 
(Uniform Resource Locator) for a World-Wide-Web address. By 
clicking on the link, the contact person can access a website 

1 0 controlled by primary support vendor 20 that presents a solution. 
The "solution" can include, for examples, a procedure to correct a 
problem, a file to be downloaded to patch application 15, a 
determination that the problem does not require corrective action, 
or a recommendation to escalate the fault into a formal support 

1 5 case to involve support personnel of primary vendor 20. 
Customer 10 can implement the proposed solution at step S06. 

[33] If the initial analysis at step S06 determines that help from 
secondary support vendor 30 is required, method Ml branches to 
step S09, for referring the problem to secondary support computer 

20 system 31. Referring step S09 can be subject to an entitlement 
procedure. Specifically, the customer ID information is sent to 
entitlement software 25 to determine if customer 10 is entitled to 
have support assisted by secondary support vendor 30. For 
example, local support may be free or available for a low fee, but a 

25 premium support contract may be required for services involving 
secondary support vendor 30, e.g., because secondary support 
vendor 30 charges primary support vendor for the service. If 
entitlement check fails at step S08, customer 10 can be given a 
chance to upgrade the support level so the analysis can continue. 
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[34] Once customer 10 is entitled to secondary support, primary 
support computer system 21 transmits diagnostic data to secondary 
support computer system 31 at step S09. The diagnostic data 
transmitted to computer system 31 need not be the same as the 
5 diagnostic data received by system 21 from customer computer 
system 11. For example, customer ID information may be replaced 
by ID information for primary-support vendor 20. Information 
determined to be irrelevant to the problem can be removed. Other 
information may be added, for example, data collected by primary 
1 0 support vendor 20 from similar incidents. 

[35] Secondary support computer system 31 analyzes the 
diagnostic data it receives at step S10. This step S10 is subject to 
an entitlement check by secondary-support entitlement software 35 
and is based on the registration at step S01 and updates thereto. 
1 5 Entitlement software 35 recognizes the identifier as belonging to a 
value-added reseller so that the appropriate level of support is 
applied. 

[36] A solution (or other result) generated by the secondary 
analysis is returned to primary support computer system 21 at 

20 step SI 1. If appropriate, data-handling-and-analysis software 27 
can merge the remote results with its own local findings (including 
those generated in step S06 as well as any generated later in 
step SI 2) in generating its proposed solution. It can also update its 
knowledge base. The proposed solution is made available at 

25 step S07, who can implement the solution at step S08. For example, 
system manager 13 can download and install a patch to 
application 15. 

[37] Customer 10 is not necessarily restricted to indirect access to 
support from secondary vendor 30. The solution generated at 

10 
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step SI 2 can be for customer 10 to contact secondary support 
vendor either at a website or over the phone. Also, a solution may 
be to download an update from a website of secondary vendor 30. 

[38] In addition, customer 10 can have an independent direct 
5 support relationship with secondary support vendor 30 as indicated 
by line LI in FIG. 1. For example, customer 10 may have a support 
relationship as a result of registering application 15 with secondary 
vendor 30. There may be a second diagnostic software package on 
customer system 11 for gathering data to be used directly by 

10 secondary support vendor 30. Alternatively, diagnostic software 
can be set up to support either multiple applications or multiple 
vendors or both. Furthermore, secondary support vendor 30 can be 
registered with primary support vendor 20 as indicated by line L2 of 
FIG. 1. This would allow a problem initially referred to vendor 30 to 

1 5 be referred to vendor 20. 

[39] A more detailed view of tiered system API is provided in 
FIG. 3. Diagnostic software includes a fault-detection 
component 17A, a data-collection component 17B, and a 
connectivity component 17C. Fault detection component 17A 
20 monitors network management application 15 continuously, and, 
when a fault is detected at step S03, notifies data-collection 
component 17B. 

[40] Data-collection component 17B continuously gathers data 
regarding usage, configuration, and context. When it receives notice 
25 of a fault from fault-detection component 17A, it gathers data 
appropriate to the detected fault to provide a snapshot of network 
management application 1 5 and its hardware/software environment 
at step S04. Once collection is complete, data collection component 
packages the diagnostic data, including contract identifiers, and 
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notifies connectivity component that the diagnostic data is ready for 
transmission. Connectivity component 17C then transmits a 
support service request via Internet 40 to primary vendor 20, at 
step SOS. 

5 [41] The functions performed by data-handling-and-analysis 
software 27 of FIG. 1 are distributed among a web services 
module 27A, a coordination engine 27B, an analysis agent 27C, a 
support knowledge base 27D, a publishing agent 27E, a notification 
agent 27F, and a workflow agent 27G. Coordination engine 27B 
10 manages interactions for agents 27C, 27E, 27F, and 27G, and 
entitlement agent 25 with each other and with web services 
module 27A. 

[42] The service request from customer 10 is received by web 
services module 27A, which performs a superficial analysis at 

1 5 step S06 on the diagnostic data to determine whether the request 
should be handled locally by primary vendor 20 or remotely by 
secondary vendor 30. For example, certain licensing issues are 
forwarded directly to secondary vendor 30 without detailed analysis 
by primary vendor 20. However, web services can modify the 

20 diagnostic data indicate it is being forwarded by primary vendor 20, 
rather than coming directly from customer 10. 

[43] Most customer requests, however, are transferred to 
coordination engine 27B, which is configured to recognize which 
agents are to act on data and in what order. First, coordination 
25 engine 27B routes the diagnostic data to entitlement agent 25 for 
entitlement verification (and, if necessary, entitlement 
reconciliation). Once entitlement is verified, the data is routed to 
analysis agent 27. Analysis agent can access support knowledge 
base 27D, which can include several databases and other sources of 
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information. Analysis agent 27C can analyze the diagnostic using 
the knowledge obtained from knowledge base 27D to determine a 
solution. However, one possible outcome of the analysis is that 
further analysis by secondary vendor 30 is required. Such a 
5 determination is directed to coordination engine 27B, which 
transfers the diagnostic data back to web services module 27A. 
Web services module 27A then repackages the diagnostic data for 
transmission to secondary vendor 30 at step S09. 

[44] The referred request is analyzed by data-handling-and- 
10 analysis software 37 (FIG. 1), the functions of which are distributed 
in a manner analogous to those of data-handling-and-analysis 
software 27, into a web service module 37A, a coordination 
engine 37B, an analysis agent 37C, a support knowledge base 37D, a 
publishing agent 37E, a notification agent 37F, and a workflow 
15 agent 3 7G. 

[45] The referred request is received by web services module 37A, 
which determines that it is a request referred from a value-added 
reseller rather than an original request from a customer. The 
request is passed to coordination engine 37B, which submits it to 

20 entitlement agent 35. Upon entitlement verification (or 
reconciliation), coordination engine transfers the request to analysis 
agent 37C Analysis agent analyzes the diagnostic data at step S10, 
making use of knowledge base 37D. Since the request is a referred 
from a value-added reseller, coordination engine sends the solution 

25 to web services module 37A, which forwards the solution to primary 
support vendor 20 at step Sll. 

[46] The "solution" is received at web services module 27A, passed 
to coordination engine 27B, and then to analysis agent 27C. 
Analysis agent examines the solution, contributes any further 

13 
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analysis as appropriate, merges any local finding with the received 
solution, and updates knowledgebase 27D as appropriate at 
step SI 2. The merged solution is then transferred by coordination 
engine 27B to publishing agent 27E, which publishes the merged 
5 solution on website 29A at step SO 7. Note, depending on customer 
requirements, the merged solution may be packaged in another 
manner, e.g., conveyed by e-mail or saved to removable media and 
mailed to customer. Once publication to website 29A is complete, 
coordination engine 27B transfers (also at step S07) the request to 
10 notification agent 27F, which sends an e-mail or other notification 
to customer 10 than a solution is available. 

[47] Customer 10 implements the solution at step S08. This can 
involve reading the e-mail notification, accessing website 29A by 
clicking on a link in the e-mail, following procedures presented on 

1 5 website 2 9 A. These can involve, for example, downloading a patch 
for network management application 15 and then installing it. 
Alternatively, customer 10 can activate a link that escalates the 
request into a formal support case. In this case, website 29A sends 
a message to coordination engine 27B, which submits the request to 

20 workflow agent 27G, which makes the request available to a support 
engineer. 

[48] Clearly, the support relationships can be extended to 
additional vendors, either by adding levels of support or more 
vendors at a given, level, or both. So that the invention can be 
25 tailored to the needs of diverse vendors, the software server 
described above can be abstracted such that it provides a 
framework that can be adopted by other technology vendors and 
third party partners of the software vendor. This can be achieved 
by creating a framework with public interfaces that allow different 
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data receiving and dispatching components, entitlement or 
authentication components, analysis components, publication 
components, notification components, and support case workflow 
components to be integrated with the framework. 

5 [49] These public interfaces can be implemented as programmable 
APIs, web services, or a combination of both interface types. The 
framework itself would provide a fault-tolerant automation 
mechanism for transferring the received data in workflow fashion 
between the integrated components listed above. The data receiving 

1 0 and dispatching interfaces of the framework can be configured so 
that a first framework instance can receive data, detect that the data 
type that should be processed by a second framework instance 
(which has been registered with the first framework instance for 
that data type), and dispatch the data to the registered second 

1 5 framework instead of processing it further. Data types can include 
sub-type directives that specify the component that should be used 
to initiate processing for that data type. These configurable 
interfaces in combination with the ability to configure registered 
data types allow for framework connectivity. The framework can be 

20 installed at a number of different technology vendors (including 
software vendors). The frameworks can be customized for each 
particular vendor environment and can be configured to link 
together in order to form a more powerful super-system. 

[50] For example, suppose a customer 10 has purchased a 
25 software product (an order processing system) from vendor 20 and 
a different software product (an inventory management system) 
from vendor 30. Since the inventory management system is used as 
a sub-system that integrates into the order processing system, and 
since primary vendor 20 has some knowledge of the secondary 
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vendor software, customer 10 wants to simplify their support model 
and use only primary vendor 20 as their support contact. If primary 
vendor 20 needs specialized help with a complex problem that 
occurs in the inventory management system, then primary vendor 
5 20 must involve secondary vendor 30 to obtain the solution before 
primary vendor 20 engages the customer 10. 

[51] Given the support model, primary vendor 20 installs their 
software diagnostics client in the customer environment. The 
software diagnostics client is configured to detect failures in both 

10 software packages. If a failure occurs in the order processing 
system, the software diagnostics client collects the fault data and 
sends it to the framework implemented in the primary vendor 
environment. The primary vendor framework detects the fault data 
type as primary vendor data. It is then authenticated as vendor data 

1 5 by the primary vendor authentication system, analyzed by the 
primary vendor analysis systems, and the analysis results are 
published to the support website for primary vendor 20. The 
primary vendor data finishes the processing by sending an e-mail 
notification to the customer, which directs the customer to the 

20 analysis report on the primary vendor website. 

[52] Now suppose that a fault occurs in the inventory management 
system. The diagnostics client gathers the fault data, and sends the 
data to its associated primary vendor framework. The primary 
vendor framework detects that the fault data type is secondary 
25 vendor data. It then forwards the fault data to the secondary 
vendor framework. The secondary vendor framework detects that 
the fault data is coming from primary vendor 20 and not a 
customer, so the secondary vendor authentication system checks to 
see if primary vendor 20 is a valid and registered vendor. The 

16 
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secondary vendor framework then analyzes the fault data with the 
secondary vendor analysis systems and forwards the analysis 
results to the primary vendor framework (since it is primary-vendor- 
type data and that is the registered behavior). The primary vendor 
5 framework receives the secondary vendor analysis data, 
authenticates secondary vendor 20, and then uses the secondary 
vendor analysis data as input to the primary vendor analysis 
systems to determine if the secondary vendor solution will cause 
any negative side effects in the primary vendor software. The two 
10 analysis results are then merged together and published to the 
primary vendor website. 

[53] Finally, the email notification is sent to customer 10. Upon 
clicking on a link in the email, customer 10 is directed to the 
primary vendors support website to accesses the analysis report. If 

1 5 additional assistance is needed with the solution, customer 10 can 
select a hyperlink on the analysis report web page to cause the 
primary vendor framework to open a primary- vendor support case. 
If the primary vendor support engineering team is unable to assist 
the customer, they can further escalate the issue by requesting 

20 secondary vendor 20 to open a secondary- vendor support case. 
These and other variations upon and modifications to the detailed 
embodiment are provided by the present invention, the scope of 
which is defined by the following claims. 

[54] What Is Claimed Is: 
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